Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-211

Provide a node health check script and run it periodically to check the node health status

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed
    • Provides ability to run a health check script on the tasktracker nodes and blacklist nodes if they are unhealthy.

    Description

      Hadoop must have some mechanism to find the health status of a node . It should run the health check script periodically and if there is any errors, it should black list the node. This will be really helpful when we run static mapred clusters. Else we may have to run some scripts/daemons periodically to find the node status and take it offline manually.

      Attachments

        1. mapred-211-internal.patch
          56 kB
          Sreekanth Ramakrishnan
        2. mapred-211-mapred-9.patch
          56 kB
          Sreekanth Ramakrishnan
        3. mapred-211-mapred-8.patch
          55 kB
          Sreekanth Ramakrishnan
        4. MAPREDUCE-211-forrest.patch
          3 kB
          Hemanth Yamijala
        5. mapred-211-mapred-7.patch
          55 kB
          Sreekanth Ramakrishnan
        6. mapred-211-mapred-5.patch
          50 kB
          Sreekanth Ramakrishnan
        7. mapred-211-mapred-4.patch
          52 kB
          Sreekanth Ramakrishnan
        8. mapred-211-mapred-3.patch
          50 kB
          Sreekanth Ramakrishnan
        9. mapred-211-common-3.patch
          9 kB
          Sreekanth Ramakrishnan
        10. blacklist2.png
          49 kB
          Sreekanth Ramakrishnan
        11. mapred-211-mapred-2.patch
          60 kB
          Sreekanth Ramakrishnan
        12. mapred-211-mapred-1.patch
          60 kB
          Sreekanth Ramakrishnan
        13. mapred-211-core-1.patch
          9 kB
          Sreekanth Ramakrishnan
        14. hadoop-5478-6.patch
          63 kB
          Sreekanth Ramakrishnan
        15. cluster_setup.pdf
          54 kB
          Sreekanth Ramakrishnan
        16. blacklist1.png
          40 kB
          Sreekanth Ramakrishnan
        17. active.png
          26 kB
          Sreekanth Ramakrishnan
        18. hadoop-5478-5.patch
          39 kB
          Sreekanth Ramakrishnan
        19. hadoop-5478-4.patch
          22 kB
          Sreekanth Ramakrishnan
        20. hadoop-5478-3.patch
          39 kB
          Sreekanth Ramakrishnan
        21. hadoop-5478-2.patch
          27 kB
          Sreekanth Ramakrishnan
        22. hadoop-5478-1.patch
          22 kB
          Sreekanth Ramakrishnan

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6106 Provide an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sreekanth Sreekanth Ramakrishnan
              aroop Aroop Maliakkal
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: